PatchSwapper : a novel real-time single-image editing technique by region-swapping

Shizhe Zhou, Chengfeng Zhou, Yi Xiao, Guanghua Tan

Computer & Graphics, 2018

Abstract:

While many image composition and synthesis techniques have been proposed, neither existing work nor professional image editing softwares such as Adobe Photoshop© provide a program explicitly for the task of realistically swapping regions within a single image. In this paper, we present an easy-to-use image-editing tool explicitly for that purpose, named as PatchSwapper. Users can simply determine the centre and radius of a pair of candidate regions or specify arbitrary borders by sketches; then, the swapping step is automatically and optimally executed. A graph-based approach is designed to find the optimal borders of two irregular regions to avoid generating visible seams. We use this approach to handle both non-transformed and transformed patches. For nontransformed cases, we not only achieve realtime performance with CPU multi-thread implementation, we also provide a location recommendation algorithm to help users find the appropriate exchangeable areas. For transformed patches, our method searches for the optimal transformation to generate interesting appearance changes on both the source and target locations. A Poisson color blending is performed onto the stitched patches. Overall the proposed approach is not only suitable for swapping image objects of any shapes but also for some other applications, e.g., image completion and composition.

The experiments demonstrate that common images often contain potentially exchangeable areas and that large content variations can be obtained by simply swapping their locations.


PDF

Software

Video:

youku

Bibtex

 

@article{Zhou2018,
author = {Shizhe Zhou and Chengfeng Zhou and Yi Xiao and Guanghua Tan},
title = {PatchSwapper : a novel real-time single-image editing technique by region-swapping},
journal = {Computer & Graphics},
volume = {73},
issue = {JUNE},
pages = {80-87},
year = {2018}
}

 

Acknowledgement:

This work is partly supported by grant of National Science Foundation of China (No.61303147), Science Foundation of Hunan Province (No. 2018JJ3064) and HPCSIP Key Laboratory, Ministry of Education.We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research.

@All Rights Reserved, Shizhe Zhou, HNU , 2018.